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for waiting Is. la aeobt mi la th. nMd f oc -aack testing at aia. S««e 

i^^i^JLlJf. adj«air*te» taogkt) taiuss the l^^ul that ifcalL 

the BdacationaL Testlag s«vl«e) which iMvlae InadtgmtlSSa for 
irrtte, , pcofiat Inaaegwte kitlfation f or stSllStr^ 
wilte their hest, or.regttlte stadents to irrlta on iiblic-ts afaout 
.Wcj ther lay hart ll-ttU Inf or«ation.- otker testa are so*3i.pie as 
not to •nswe even aatglnal literafey or they fociis .echtecal - 
skills eselnslvelf. rhe ^ata which broofht about the deiafifl for 
testing ace open to guestlon cultaral klaa oa tests, inadeflntte ' - 
ttnaex^tanding.of test tesalts, and, Irceaponsille *ast of tes« 4ita 
cMate confoslon afceat liter aey lefels and aake the t^ik "f^ncttonal 
illiterat." .ejnlaglass. The aaiaad «or 6o.pet.ac, testing"! Shen 
1 aaj^r breakthrough In teaching readiag iay t'reTiew a sikla" 
deTelopieat in teaching wtltiBg. The school sjstei in ingland and the 
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. When th# VmS* go^mvrmBmt sat out to tnnocuiata tha .ooun* 
for swine flii, thm/ieotBion saemad both raaaonablt and non* 
t^dtraraial. Ihm dit^st ws^m a aarloua ona« and nAtloi^l 
hailth Qfflelfils asawed the prasldent that a nasa Innoaula- 

^ program aould ba met up. Vasclna ruahad irito produeilon, 
and iraeelnatlpn ceritars vware opaned^ But a ftw Keeks Into 
tht program a number of thoaa who had bean ^acialnated con* 
traored a frightening paralysing dlsaasa, and the vaoelna-^ 
tlon prDgrara cmme to an abpmpt halt. The goverruneiit ras faeed 

-wlth^oTar fifty oilllon. dollar In LawsultSp and noat likmli^^ - 
will ta raluctant to Initiate any kind of masa Innooiilatlon 
progran In the'^naar futtire* 

Thera la a parallel batwaen the sWilna flu Innooulatlon 

program' and , tha com patency tegtlng programs that have bean 
mandated in tl^lrty-^ three states, rhera le the seeming elm- 
llclty of the proj^tem; there Is the asaurance by testTOkera 
(niost of wh^ stand to mak^ big profits by selling teats to 
states) that such tasting Is .faaalblai there %b the haste In 
setting up the programs* There is also th^ possibility that 
such testing ^11 ^qrk to the /severe disadvantage of some 
Individuals and groups* And It Is very likely that once the 
compdaxlty and costs of mass testing become apparent , state 
leglalaturea will have second thoughte ^bout oontlnuing these 
programs. , " ■^ 

For now» however, the -eompetency testing bandwagon la a 
very comfortable place for politicians to be. A recent Harris 
foil fourtd that two^thirds of these polled favored the Idea 



oC nationwide st&adards far high sohool students.' BvMtnee 

SttoK at thtf ha^ Mottl of Ohio to 

tiit*afta<^© a t^lll calllftg f or the natloiii?ide testing /of tasl e 

skills^ Deaptta eu0h put lie pre s aura, a ^nel^ appoint 

by the Department of Health Eduoatlon and Welfare/ r^Je^ed 

the rjDtlQn cf nationwide or even statewide Qompmnmnoy. tasting 

Afiy testing of mliilmal oonipetefiDy staridarda 
^ fet avardlng the high aahoal diploma however 
under standable the public olamor whl^h produoed 
thm ourrent movement and expeotatlon « Is 
ha^leally uairorkahlep excaeda the present mea- 
sui^asent arts of the taachlng profasslonp and 
wlil create more aoelal probletta than It can 
cofioei'ra^ly solTe.l 

A atatamant auch as this Is bouiid to be iriet by akeptlclam 

by legislators arid layman. It must seem Inoratilble that= a 

sociaty so praocouplad with meaauramefit and evaluation 

laolcs the teahnology to teat isaalo skills* Educators are 
# 

surely trylnff to hide their fal lures » or, as an editorial 

In tha Pansaaola ^ews argueds , ^ ^ . 

One of the "best raasons we can think of for ra- 
quiring the passage of functional teats before 
student a are granted a high school diploma 
Is that ao iiany people seam to fear them* stu- 
dents and school off Iclala alike. 

It ' 

BducatorSf If their protests are to be takan as anything 
more than def anal^anesa, must clearly explain the Inade- 
quacy of the taat^ now being used. . In^thts paper I will 
footia on the aaotlona of these tests which purport to test 
writing abilityi 

Any discussion of testing raqulraa an explanation of 
soroeof the Jarfcrt of teatlng. On% key term Is validity . 
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paxticuiajrly e en ten t -' valldl t y . A te^fc has content valldi ty 
If It truly tests that which It claln»S|to test. For example. 
. a test which olaitted to test writing ,arti|i only reqiired stu- 
dants to SpdLl m llfct of wijyds would Laek content validity 
because i^tasts only one aapeot of writing. 
■ One of the najor questions ooncernlrif oontent validity 
Is whether a writing tes^^an have such Talldlty If it re- 
quires little or iio wrltlrig. The Mucatlonal Testing Servlee 
has long olalaed that an actual writing sample Is ^ot neces- 
sary , although due to pressure from English teaohers, they will 
Include a twenty -nlnute writing sanple in the December, I978 
English Composition Test. Ihe ITS Justifies the predonlnanoe 
of fflultlple-eholce qud'stlons hy blalmlns that such t-uestlons 
allow the test to sample a wider range of the student's know- 
ledge p and they olnlnilse the danger that the student mLght 
be sa^eraly periali^ed for ml&ln^erpratlng an essay qiiestlon 
^or fol* having nothing to say on the assigned tDplo. The ETS 
also cites rasearoh that demonitrates a high GDrrelatlOii be- 

^ireen the multlpae^choica questions they use and the actual 

3 ' 

writing the students do. 

Critics of this apprQaoh to the teatlng of writing argue 
that It runs counter to a basic coacept of fairness* If tests 
are to measure^ wrl ting ability, 'they puet eTOluate the i^^rltlng 
of the student* Once i^e begin to enter the world of cor- 
relational we enter a slippery world Indeed* ^On the New 
Jersey \Baslc Skills Testp for example, there Is a aubstan- 
tlal sactlon which tests a student's ability to cottplete ana-' 
logies. No doubt stich items correlate highly with language 

♦ Hereafter referred to as the ETS. 



\liiaguage ablllty» and:ar© good predletpra* of future perfor- 
mmm. Y^|it aan hardly b# srgM#d that c^pletlng aa analogy 
Is a bas»^iklll. It has llttlt dlraot i^alAtlonshlp ta the so- 
tual iaiiJI^ga actlTltlag itudants miast parfqrm. la^ It fair to 
test tesie skllla by tasting non-bajla skills? * 

Grltlca also argue that the STS Justification rests hea* 
vlly on the olalm of expedlenoy* It Is/axpedlant to oonstruat 
a' one hour tast, most of whloh can ta inaahlria-scorBd. It Is 
aipadlant to raly on maasuras that corralata wall with writing 
ability rather thkn going to the trouble of evaluating a fair 
sanpla of the student's work. Such a aaaple, abcordlng to 
John Mall«|||^would be 800-1 p WO words, drawn f r^ f our or flira 
assays.. Can states, on the one handp attenpt to make daolalons 
on the profleieney * of Individual students » and on the 
rely on measnre.s ' that bear a largely itatlstioiii relationship 
to this proflcleney? 

A ne%i type of validity has bean proposed In raferenoe to 
the oompeteney movement Instructional valldl ty , A ta^t^aa 
Instnictlonal validity If the bbjeotlves tsated corre^ond 
with the objeotlves of the Instruction that the student has 
recalved* In other words # It Is unfair to test students on 
material or skills they have not baan taught. Merle Wc* 
Clung, attorney for the Center for Law and Edueatlon in Cam^ 
brldgap has argued that the Florida tests lacked this kind of 
validity, and that the cdncapt of irff tructl onal validity: may 
be tha basis for li^gal oasa^^rought Iby students,^ 

, At first glanoe^^hls conoept of^-TOjidlty would seem self- 
evident. But' It follows that If s^tes art to administer 
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Gm^etmoy tastSa the J as. ofV^ must o^ineid© ; 

with the eurrlcula In the sohoola ^^any of whloh have wldtly 
dlffarant ourrioiila. Competency testing praiuppoaes a Uinifoi**, 
fflity of objeativag that most likely does not exist. * ^ 

The ^onaept of Instruotlonal TOlldlty also leads, to* an . / 
Injisbapable illaMa* To sat objedtlves that do not colnolde 
wl%h the s^^ool curricula la to test oompetanclea that afu-- 
dtnts may not have been taught » but to teat objectlva that do 
eolnolde wl,fcn sohool objeotj^ves Is to. In effest, conaona the 
ediicatlonal pspaotleea that produ^d the "crisis" In the first 
plaae* To ta^ka w ng Instruotlonw^ an exanpla, the National 
Couneil' of VBBphBTB of English has cd^lstantly argued that 
students often\fall to learn how to vii^te because of the pre- 
occupation wltt^ grammar and oorreotness In the achools. But If 
a statewide tedt Is to have Instruotlonal v-alldlty. It muat 



foous on what 1 



r 



B taught, graiiinar and correctness. 



The aeceptable validity of any test dftpands on the type 



of decision thalt the test will help determljiap the mora im* 
portant the dec talon, the greater the level oT validity i*e** 
^quired. If a tijacher wants a rough Idea of those students yfho 
might Have basic writing problamSs a short^ essay * on the first 
day tff class o^ty be valid enough, Suoh a diclslcir Is re * 
versible ; the jiaohar can modify an Inttlal Judgment* De^ 
olslons, ba^^ on corapetency ^tests , about who and Is not 



o grlwJLua^ are f ar less reverslblet In part, ^eoause legli- 

I / ^1 

lators^'^and par^ants seem to distrust the reversible Inform- 



atlon that a teacher might provide* While the itudent may be 
given a second and even a third chance, the judginent of his 
GOinpetency Is baaed on no •more than a few affcernoon's work* 



Given the alfnlflcanoe of^he decision to j^rsduata or not to 

gr&.dtiata, and gl Tan the limited reTarsl till ty of the declaionp 

It^ would^f qIIqw that tha method of testing as iralil as 

possltle. As Terry Tanflrl^kp a apeclallst in eduoatlDnsl 

jseasiireaant has atated," The Informfitlon needed to mmke * 

thesa kinds of declalona oust be as aooiarate as poaslblep 

/no matter wtmt the cost. - 

^ . • ' ' . ^" " ■ 

It Is the daolalDn to^ axcluda taaohars from the deter- 

mlAatloJi of oDmpetejioy that reduoea* tha validity of oonpa- 

tency testa, Teits alone» so the legislators state, must 

deterin^e oompetency, Xet moat textbooks on eduoatlojial 

meaauranent argue that Important decisions about puplla should 

npt^pa siade without oohf Irnatory eTldwoe fr4© parents and 

teaoharSp and the opportunities to change sixah decisions,^ 

lha need for confirmatory evidence Is partlaularly acute Iri 

Judging wlting ability^ for writing perforMnoe can vary 

gre^JV from topic to topic* ^ It is extra ordlmrlly difficult 

to find a single topic that will elicit the bast Korlc froni 

all students. tested^ 

Some Writing Exanisi The Trivial 

. Acoording to Gary Hjrti author of th^ Call f ornla ^Pupll 
Proficiency flllL, one of the purposis of his bill warn to 
restore meaning to the high school dlploiaa and thus Im- 
provt the public's attitude toward their sohoolaf 'Ihla 
rationaLe Is echoed by most proponents of competency testing* 
Wany of the tests 4evlsedp howevet, are either so simple, 
or po marginal to the basic skills of vrrltlng^ that It Is 
Uf^lkely that they would meet Mr* Hart • s ob je&tlve* 
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. The Items dtTlsed for the New York State Competenoy TmmtB 

BBBm to be so easy ,that it Is doubtful that the ^publla would 

be asaured of the llteraoy of a student seorlng above tMe 65^ 

out -off point, dne of the aampla questlona In^mechanlcs Isi % 

: Somebody the window* 

has broke 
^ . buat 7 ^ 

^ has broken 

bura^^d 10 ^ 

' ^ ' \ 

ouestions In thp . aaptence writing aeotlon are easier. 

Studentis.are asked, for example, to use "will eat" In a sen* 

tenoe. Aoobrdlng to the rules for soorlng, all studants must 

do la to yoomplete the sentence with no maohanleal arrors» so 

jsump mly the students could oorreotlj^ ^respond with the sen* 

tenee« "I will eat,"^^ - 

One of the proflolenoy tests that Is generally taken as 

a model was developed by the Denver^ Colorado school systemi 

Students have to do writing on these exams, but are given 

a "Language Proflolenoy Exam" whl^ch asks them to proofread ' 

50 lines that •'might have been written by a student.'- 

Surely "language proficiency'* entails more than proofreading. 

Another proficiency test, proclaimed by Its davalopers, as a 

success, was developad by the Westlake, Nebraska school system* 

The writing exam requires that the student ^frlte three ra- 

lated paragraphs on a topic agreed on with the teaoher and 

that the writing contain no more than five grAmrnatical er- 
13 

Such attempts at measuring writing oompetency are 
Inadequate, not because the meGhanlcs of writing are unim- 
portant, but because "prof lolent** writing .Is more than "cor- 

ERIC , 9 



- '^'^^- -Wttng.: Imagine the siud^nt 

• •, "sl'>S «hort sMtene... h ^ •J"'ta»tle error. ,; 

tractiona, and l« ^ ^'o avoids oon- 

Senerai, he tries to ^ 
: - P-i^la. ,3 this . / " 

-i^forea the the «a ! ^ -"^^tanoe. o. ,0.^ it 

"e the negative lnafte that 

-ruing, ^Pn- Graves Who - ^ "'""^ have about 

^v^^, wno surveyed l=h^ 

• the United 3ta^ H '^^^^^^ °r lanffuaffe arta 

tate&^ deso^ibed this attltudsi 

quette in ihS iSlds^i^''^^^^-^ » °f etl 

errors Thi J bub free or ™f .! "eO"' 

. M .fli- J^^l^^ 

attlrel °« his llnr-!'|°°f «e has . 

.actired, defflonatraf* 4-^ - properlv 

r„ts such- as thoX„.„tlonea atove have 
saoar Mucato,- * ■ Prompted n : 

- .e.e 1 , :r":-'^— - - tes.a.r;to 
~t a.vertil Tr^"" ^"""^^^ ^-"^^ - 

«e custoner arrives at i-u 
""Ct. unfortunately u P^o- 

ej.y, ig sQj^^ would fh^ 

design the compe^pncy ^hose who 

pe^ncy progPflffls make, olalais sim, 1 . 

oade by the ETS th 7 y similar to that 

- ^-^S that oompetertcv w*^^ 

baelo B.ai, needed to be a " 

CO be a productive adult- ^4 ..4 
Of funotlonlng m a 1 

^ in a complex aoolety Th^ ^ 

to test marginalia " ' ^^''^ Proceed 
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in falrnasa to th© testmakarSt inany of tham are In no,- 
win situation for they auat daai wlth'^tha "Qrowoho 
Complex,'*^ 'Grouoho onca aald that he eoiild not raapect anr 
olub that would ftsv© him as a maabar* The only imy a olub^ 

Jpould Iceap his reepaot would ba tot^ Lt to axolude him. If i 
a'lmost all studants pass oompatanoy tests, the p^lle will 
view^hsm as too easyt too unsal^^tl^e. Only If a substantial 
nuinbar of studants fall will tests b^ perceived as hard 

^enough. But syoh a.fallui^a rat© iflll obligate the state to 
provide ramadlal eduaatlon at a substantial o!oat» And a^l svl- 
denea^ Indicates that.manjr^ of the^e failures will ba minority 

and poor . students who generaaiy do poorly on standardized , 

.J ~ 

Vtasts* Aa Staphen Bailey^ a •meabsr of the HEW panel on coinpa- ^ 

tenoy testing, stateds 

If success on tests — for the p\irposes of graduation 
or promotion Is aehleved by four-fifths of *a subur^ 
ban school system but only one third of « o^ritral . 
city's system, the oons^que^oes 6ould be serious for 
domestic tranquility as well as social equity In a 
world where a high school diploma , regardless of 
Intrinsic meaning. Is frequently a ticket to par* ^ 
tleular Jobs. . ^ 

Given thlf ominous possibility. It la not difficult to sea why 

some states and communities have selected easlly-^achleved 

levels of competenca. 

Some Writing Examffi The Insufficient 

Most of 'the states which are developing DompetenGy ^eets 
have chosen to evaluate writing for nore than mechanical oor- 
rectness. A'lany states, rather than developing- thelsr own 
writing exercises, have used - exerei sea developed by the 
National Assessment of Educational Progressf or they have chosen 

♦ Hereafter referred to as the NAEP 
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tests developed by coniinerdla3i publishers auoh as the ETS or 

the MeasuT^nent Aosearah Centex*. T^er^ appear to be two ■" 
reasons for this deptadf^ce. n¥st , many state lesislatwas 
have set deadlines that do not alltow for the tlme-consunilrig 
process Of field testing and- ooASvlfcatlori. Second', state 
departments nay, feel secure In selpetlns exercises that sup- 
posedly have be^ validated through field tests. 

But this depend^enoe creates other ^poblens. As noted 
earlier, if competenoy tests are to have Instruotlonal valid- 
ity, school ourrloula ttuat stress the ^ob jpotiv^ of the tests.. * 
Evejr^lf states determliia obJeotlTe's, the testnakers will specify 
what types of writing will ajeet the objectives. In effect., 
major" currloular deolslons aiay be made by Independent and senl- 
IndepeMent □rgaKl.atlOrtft ;Gliaply, the types of exerciseji " 
triat are being passed on to. the states must be carefully 
examined, . ' ' 



c&mpetenoy test la artiriclaj. to a degree. A real 
ttfst of competency would take place In a .situation where 
^the student actually had to use a skill to get what he wanted. 
Here motivation would not be a problem. A writing oompeteiioy 
^test, artifielal at best, can easily becMe so artificial 

9 i 

as- to become an inadeauata test of writing. To go back to 
the traditional rhetorical triangle (wrl ter— audlenoe" i 
subject), there Is an Inan table problem with audience. The 
student, even if he Is told to write for a friend, or teacher, 
is ultimately writing for en unknown exaBilner. What a tes^ 
can assure Is that the fitudeht not be aaked to write about an 
unknown subject, for If he must write about a topic he knows 
iTttle about to so^one he knows nothing about, It is uti- 

10 IZ 



, to sa ^ n.he least, that, he will pToduoe his test* 

Dtspl ti th € r eacL-lfiess of states to i^se MaEP exercises* the* * 
r^coid of the NA. EP has not , been pSLrtictilarl.y gocd wtien.i t - 
coina a to st^laTyla tlixg wrl tlngp John Mellcn^ t n Jiks analysis 
pr tJie first ^ou M results (1969*70), clained trie NAEP fslled 
tO' adafluately lo tlv^^te the students to wrlfce* 3y handing out- 
toplos^and ax jec tlnj students to do their beg t .v^ork . tJie NAEP 
seamed^ to a^opy ttie teohnlqua that fails so regularly Ix the 
classroom, fHelion found the secoiid round as segment tc toe little 
better^ Tl%e sve*flg^ length of plsoes written by 1?— yesr*^oLds 
wa ^ Only 13 7 wrds^ the length of an aver'ag e paragraph*"" 
, Unless a rr Itl^ng assignment can stimulate (^nd &llQi^ time for ) 
th« student to has best workp the mast s <)pini ^tl cated eval- 
uation techiilqiue^ o^n tell us little* 

Tl^e iLinl tg . Wo^t^ the tests which require stuidents co 
wrStm put liil ta on the time allowed* The M'S h^as genemlij 
been the mo^t ra^trLctlvep usually allowiiig twenty minutes, 
Th^ a^gsUmption^ s^em^ to be that a good writer Vfrltes faster 
th^ii ^ puor^r gu^j thi^t aiiywn^ hIaj iwiui^J thtt L JliaC ilia It 

unduly re^tJ-^lw llvre v^uUlJ pxuUabiy be v4l1i1u^ Luw slovtfiy^ t^ 

^ept %hMt b^tt ^i- tQOL <1&V ^ read L&^lmv than yi^uT^r I'^atJoLa^ ' 
T^ha^t does resaj^rc^ h h^^ve to a-ay about the vitLtin^ bch^vl wt 
cf gQOd aria pu^r wrl taraV 

Charles ti"tfti lar^ d aompeiieid the hi i i ii^^ ^fcii^v lo* ..t 
group of good ^^tJ^^s^'ftde wrltex^^ with that c^r a ^i..ui^^ 
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,r«ndohly selected 12t;h grader «. r 
. . ^ «ood . ^r..p „»te- „„ ^ ■ ■ / 

compared 'to 3 Oi*. ) tv,^^ + , / ^erage (356 words 

^ ^' tne:y took Co^slderabLy lor^^. , 

mmsny select^^ , — «ISabl^^ slower than the 

. Aie of the no St slffnifi ^ ' ■ 
uac sigrnricfint studies in+h ' 
r^searc^iera and 'Siting 
- ana for oowpete^o* rsc-*. ■« 

^s. th< ^^^^^ donea/t^r ^^ 

- t^i'**.. th.,« j^,,^^ 

to re,uu., .u.,.. . 

- While the 
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•"5* t' ^ '*' * 

/ ' test., essay Is" precise! v f iw„^ , 

writer rewrite. perhaprLlici f^ research, 
reaction of others ani fi ad^loe and 

jrocess In writing «J ,^ ^° throuj^^hl s 

premium on verbal 1 Lencv a^d Ji""^ ' ^^'^^^ ^ 
position, ^arpartLu?a\V^ to'?h!^,f' 5°'"- 
vantage of the slower -^tnL f \ dl md- 

Ot,e.'rea^^,,„. ^^^^^^^^^ ^ 

: Pe^t., ^^^^^^ ^^^^^ ^^^^^^^^ 

.u«,e3t t.at ,,,, ^^^^^^ 

and ni,..oHooi.tudent. 

^rr.y, .Ho has „ade an exhaustive st.., 
.wxitlng habits ur published w^lt^z", 
an essential pa^ L u£- Liie w, i 1 1 
Period or W..U^..,-ti. '.„lse p.. 

«-nt«,uptuous or the practlu« 



wh.n our "uid" sfcudiats ne Tti^' "V ' " ' 
)^imu«, a.^<il« o.er b i,r;ap2^' f' °" ^ ^ 
"I can't wnta." while the 2 I" ^t^- 

write on conimt.rid. e1aciil«?f. st-^dent^ wHo oan 

without thought. 'ror S?ers®^ «^"f- '-^'^^^ ^^^-^ - 
writing. ^ ' -or writers have to write beror / 

i'iio Wi 1 Cera w^re t t *- t 
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llke^to adroit, didn't do w^Il In L^ngll sk or 4 
, school, 2* ! 

Bvenyoune children r!eed a period of time to rehearse whmt 
they are going tfc v/rite; Graves , In his study of the coin- 
posing process *of seven*year-olrts # noted that mBny had to 
drat^ and talk aloud before they could wlte. This activity 
v<ms Indispensable preparation for such students, -5 

What then are we to ^ake of the clalnis for the val- 
idity of writing tests. The fcTTS, for exaniple, ulalni 
in their jrranual fur the Basio Skills AaseHameirit that; 

Whlia no procBa-s can be said do ^:u^raiittid 
the exlsterice of content validity, the stefjy 
ciirried out In developing the specif 1 catioris 
^^/or the BSA certainly resulted In a hl;rh 
^ pi'obablllty of ^eafuras with content valldii^^ 
*** a comprrehenSive review of research^ other 
relevant materials froiB testing pro^rsins . and 
Inf ormatlon from locai school districts and 
professional organizations provided the pru- 
gram with a large data base on the assessment 
of basic skills which could bo used to 
develop test speci f Icatl ons . 

to claliD^ a^^ the IlTS doea * tmt » lai^^e L.^aj ui i ^^^i^r^li 

uggests that their measures are valid le to i^uure trie 

fact that another body or resesrch and ini^ormed □plnlun 

rej^^utti the validity uf Lii^ ^iO -jul au t NriLli,^ ^t^mpies tas 

a mc^^^Ure uf wri lln^ prurloi^nuy. Uriliua wl Uic ^TS wuMia 

i'jMt' that sduaat^ra why ulaliu tu ^^.^eaa ti.s MilLiUf. c-^iblilL 

of Ifidlvlduail ^tudenlG tisiV^ ctnlu^i wUii^^utlun to t^iiww 

tne student tw WXdLc Undei- L^ie beat i.wu^^lUie U^fidl 1 1 la , 

including tl 

pia is not llKa « bluui sd^mpio, it u«iiuwU ^^itmcLca 
a few ml nu taa . 
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Creative wrUtn£. Thfi first rouad NA SP raxcrcls'as w»re crlt- 
. Iclzed for their narraw focus^^' I ma*^l native or "creativs* 
^ writing W3LS not called for. Subsequent exercises Illustrate 

0 

the general corifaslon about Greatlve writing. As with many 
changes In English Ed nca tlon g _th^ mov^enient tov/ard creative 
writing, was a reaction apalnst/lthe exclusively anal/tlo and 
functional appruach to writing In rnany U\ S * schiiQis. Ihose who 
In the 1960»s reacted against this dominance, K«a Pl^crorle, 
Jaiiia^^ nuli^tt, Uwii Muxraj, nnd uthex^a , ^rMu^d fL^r the liiipurLanu 
ut the HcX'uc p LI ^ ^ GApsri H/ic> e s ^ ^fid Vol o e wi Ihn 1 na 1 y 1 d uti 1 ^ 

sLuUent, the liu^wi LaiiL^c the i '* ttia L Wei^ uf L^n piufilblL^a 

by hi^h oohuui I ^teitih cL's . 

Ircs^ ^i^a 'Mcaiy" uuU ail Lxwuk^^ "babble.'* iia if.u,). 

o Illipl J ilt. w U i U .1 " U , 4 1 I. L I N.i^ I sc^i . " l- N i i h^j I 

liwU llwll^ui ..i.^i :gUv. f3uL 1 la 4u . , u ^ % 1 ^ ^ ^ 4 . ..i^ m . . T s.. L i . 
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Qisar according to the Uhio manuaX» Is for the student^ to i - 

•^demonstrat a abl llty^ in, ^^rl tln^ to reveal personal feelings 

and ideas tiirough^ fr expression*"' ' . . ^ ' 

Sometlcfias pep pie write jUst for the fun of it. 
ihis Is a chance for you to^have fun writing- 
Pretend that you are a pair of tennis shoRs. You've 
dona all klndp'' of things with your owner in all kinds 
of weather^ J^ow you are b^inff plck^^d up again by your ' 
owner. Tell 'what you, XYie tennis shoes, think 
about ^hat is going to happen to ,you. Tell how you feel 
about yo\XT owner* 

Surely their ar=6 better ways to ^unns^ tiUlilty ui the stuy^ 

dent to express personal feelings than to ask him to Imagine hlrnself 
a pair of tennis shuas, 

AfiQthei" Loplg- de'Veloped by thrt ii^^i 1 i 1 u a 1 1 u t er. ^ VWm suxiia 

tAri ovex^ turned dory, lha dory Ik Ufi a duok whluh. i ce^uh^v^ in- 

tu a ^^tiittil lui^t W^iCl'& oailbu^^S s 6 Juuwi cU, 4^u.jb'^ I a K 1 -Lhie? 

te^t wei-e ^Iv^eri th« roll^uwing ina truct i un d i 
JLouX uar^i'ui iy at th« plotiii c. 

boat, Im^^ine you are one of the hlidi^eii in the 
picture, Or'if you wlshp lma*^lne you are sorrieone 
standlrig netirby waLchini? the children, dell i^^na l 
is i^olng on as he or she would tall It. Wrlt^ as 
If you ale Lellln^ this to a «uod f 1 1 «nd ^ In a way 
that eA.pre&sps stTK^r\i£ faglln#<s. ii-lp yuut filund 
feel the ex[)emence tuo* 

^> » J I V i i = t ^ 1 S V 1 . i ^ L c S the liUJ a t i I..- i . * i ^ I V. i ^4 Mi \ 

pi t UX'e gfiSin bd ^bwut 0 yrtaio uid^ ^fiJ lew 1) eii.a i/ 

year old students (why were ^iv«a iFic ^s^? iRiun.ait ) wouia 
motii^ated to ^wrlte about childi«n aw UiUuh ySiun^br than they 
are, Althuugh 1 distrus t the ^ul^^iu^Llu^ arlLiol^in ux" ^.^ui 




ur»fa«lXi«r to students who-hav^apent np tin,, at seaside or ' 

; lakeside resorts* 

But the biggest problem with such an asst^nnient Is th.t 
Vt seemsVto invite a, W^hly sophisticated phonlnesa . It 
forces the student into falseness. 'The!' f ol lowl n« piaoe was 
.iven a top rating by l^AEP Judges on this assl^.nt. Thia 
Piece, according the the NAEP. domonstmtes n™a«inatlve 
entry into experlenGei" 

Jumping and running on the boat 's very enlomble 
Up wejunp and down we float. I fe^l a- if r 
sail the boat around the"«orid and bacl'^ Th^ 

0Hee.s!''' -n-otlon. Ihe wind beats .,2fnsr' 

leeis like WllK(?) to the touch. The trees are 
alive, pulsating, watching our ohlldlsh^les 



X feel like I could play forever. No ou, cepl al 
time, no stresses encourage my exuberance. 

I'ly body has separated from ^y spirit. I am no 
longer encaged In a prison k bone,. skJV 
Thera are no barriers now, I can wh.teieW 
I want, whenever I want. (««e l?)^^ ^ 

.'^u.^ij. ua. IS . ^Kliled wxiter perforDilng an «.K.«rd t..., 

■^u. ^g,^^ ^^^^ _ difficult. «„d I beilsve 

ai.i..u««L, «t«,.., t»,.i. ... ^^^^ 

dimcult ... u,a w.lti., .uua,a. a. ... 

Wa«^.ln«Lon .t.t« u... th« ........ 

fracle writing te&ti 

^erhapi it makes you have one ,eelln«\.r inotnpr 
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Now listen to this piece of, mu-sic and write' abQUt 
what things thls^-^ niece of music daeg^ to you. Start 
writing anytime you wish. 3^ \ * . 

^hiie such an exercise may be a good one for^J^ree wilting, 

it seems unlikely that it is specific enough to fflve the stu- 

dent an idea of what Is expected. ^ 

Wrl tln^ and 1 nf orma tl on , Writing' must be nbout soniethlng. It 
Is not some set of skills that can be assfjssed apart from the 
act oC communication about a subject. ^ 'Ihe ffreates t and most 
cDnslstent weaj^nesg of the NAEP wrl ting exerc isej is th eir 
f al lure to ask students to wrl te on sub J^c ts they know some- 
th In^ abaut . ^'Ihey move the student Into nTeas where his know- 
ledge is severely limited. He often finds himself In some 

:> 

hypothetical terrltury where he inust b« "creative^" or he Is 

pusined into wriat Don Graves has Galled "extended territory V 

rmtlofial a,n_d 1 n ternti tl onai eventB and per sonali tleg , When 

the student must write about this extended terrltcny- he oftHn 

writes with limited Information* An ex^iaplt;: 

t:yeryQnQ knows of somBtYilnK that la HorLh t^ikln^ 

^ about* mybe you know somethlrt^ about a famous ^ 

building like the Eraplre State Building in New 

York City or something like the Golden Gate Bridge 

in S^n Francisco^ Or you rnl^ht know a lot about the 

Mormon labernaole in bait -Uike City or the new 

#>'^ sports stadiums in Atlanta or at* Loula, ur you 

may be famlj^iar with soniethln^ froni nature like 

Niagara FallSt a .^iffantlc wheat field, a ^rove ur 

oranffe trees* or a part of a wide muddy river 

like the Mississippi ^ Chooae somf^thlnR you knuN 

about* It may be something you have see0 while 

travelling, or something you have studied in 

school* Think about it for a i^/hile and then 

write a description of what It looks like so 

It could be recojfnl^ed by someone iNho read yuur 
descrlptlon.32 

while ostensibly this is an open astil^ninent, the = 
pJioatlon is that the student shuuld wrl la abuut somethlfi^ 
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.-"iniportantp" feoraethlng famous, and not soniethlng as Inslg* 
. nlf leant the .studerit 's home^ or school or favorite .park. 




students have with such assignments. The foLlowlnij piece 
was written for a similar NAEP assl^n^ent where students 
were asjced to vrrlte about a person they admired. As usual, 
the possibilities suggested were all national figures, Wlck^y 
Mantle , Winston' ChurcrilllpMartln Luther King, Jr. This pteca 
was rated In the 87th ^lle of the work done by 17*year-olds i 



Or* Chrl stain Bernards I bBllev^a he is a person 
worth looking up to. has triad to make our 

life longer .for us through resftaroh about opera- 
tions on heart transplants* His det ermlnatl on 
to help mankind is reoognlEed even though public 
opinion Is very much against the priaotloe of trans- 
ferring one person's h^art to another person. 
This determination shows how a true doctor or &^ny 
kind of scientist would work for the betterment of 
of mankind p both for a longer ll^e and easier wotX± 
to llva In. Dr * Bernard shows the dedlcatlori 
of a true doctor^ to help man when lie Is slok or 
dying, as are many of the people on whom he op-- 
erates. His determination makes him try to 
show the world that the heart Is not a sacred or- 
gan of the body j and Is Just like any other part 
of the body when It needs to be repaired* His 
determination to find a better method, new drugs 
to help after surgery, is to b« admired^ This 
Is one of the reasons I admire hlm,^^-^ 



^ii^il^ih,*' ^ttt student laoks wriylhlnM ^peu.lf lu to ^bwuU 
Ur * Bernard and rnu^t resort to abstraction^ and platitudes* 

Wen sorae af the more practical types of writing 
oreate pro Die ins* axerGlse raqulres student a tu write 

a report about the moon^ ^ . 




In the box below are some laets about the mcjuri 
whl ch you can tise f or your re port , uu may ad U 
other facts that you can remember about the moon 



■ ' P&Qts 'amut the Moon 
Wade of rock 

Wountainous, contains, craters • ' ^ 

Covered with dust ^^^rers 
• Wo air or water 
.Wo plant or anlmsl llfg^^ 

_ "nles. .eu.«„. ..3 so.e Ir ... „„„„ ' 

«.o.a ^^^^^ ^^^^^^ -^^^ 

— • — e.....„„„,,,_^ 

trie^ facts ar? ni^sr* ^.u ' * 

Clear In themselves, auoh an , 
_ »" assignment, would 

'l>.o see» to be a questionable test of r- V / 
a, ,f ^ writing, aehylng 

■ , ^"^''^--^ -rotation is .130 .,i..„, 

" -l„tt.i.„rltln. noises. or tHe «... 

"""'"^ '^-""^ 'olo the fcil„„i„,.. 

Chris Jones lives Mt ^Xnn i 

junior year at high school . i"! 'InlsHaJ the 

— t„u.„tl3.,alnp.t,nae..lou. po3luon. 

-.Pt MS or Her a..res3 a„a m school. ..criteria ' 

used by the MEP In ei/aluati^ <. - -t" 

that tot ^"'""""^ l«"«r. ol^axly sho, 

r ''^''^ I'Her sh,.l. in. 

: ^ - -.nncatlons. an. a .a, 

-la criteria ....r 

Er|c>,„ . . 2° 22 
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a letter, the instructions do not make clfiar the necessity 
of the^tiident inventj^fig such Inf or|atlon . 
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^ Conclusions and JJiscusslon 



1. While the multiple-choice test oT^wrltlng Is cheaper ^ 
and more convenient to administer than a test which 
requires extensive wrltinff, the multiple choice test , 

lacks content validity. Any olalm for the validity 
of such tests rests on the corralatlQn between them 
and actual measures of writing performance. 

2. Competency tests raise the issue of Instructional 
validity, the correspondence between the objective's 
measured and the Instruction the student has received. 
A legal argument can be made that It Is unfair to test 
students on material they have not been taught, tet 

to focus on the objectives tauflrht in the schools is 
both difficult, due to the lack of uniformity from 
school to school, and profoundly conservative, In a 
sense endorsing the practices that led to the cur- 
rent dissatisfaction, 

3. 'ihe acceptable level of validity of a test depends on 
the type of decision that Is to be inade, the more im- 
portant the decision the higher the level of validity 
required. If a test Is to determine promotion or grad- 
uation, It must be as valid as possible, no matter 
what the cost, 

4. Many states rttLtier than developiriy: their own wrl tine; 
exercises are adopting those of the Watlonal Assessmpnt 
of Educational Progress, the Educational Testing Service, 
or other national testmakers. 

i. Suiue ul Uiuae exercises that have Ueeii drtVelop„J by atuieo 
and local cominunltles are eiLher an slinple that they 
do not ensure even raargintil literacy, or they fucus «jt 
cluslvely on mechanical skills. Ihe emphasis on mechanic.^ 
reinforces the myth that " prof 1 ul ent" writing is "correct" 
writing. 

0. i-any of the tasts pruvidttd by naLiwiial MX Kanlza tl wiis , 
particularly the c-ducational' i'estlng Service, may well 
fail to «ive students adequate time to demonstrate 
their writing ability. Ihere Is evidence to suggest 
that better writers may be slowet* writers and that the 
Impromptu assay may not be an adequate gu«ge uf writirv 
ability. 



7. While It is extremely difilouit to devise wrlLlnjf aa 
si^nments that are stimulating for all students thos= 
used on competency tests exhibit some glaring wetokness«j.-. 
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the most serious being the teni.enby to require students 
to write on topics about which they h^ve little Informa- 
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■ Much of the^ demand for wrltln'g competencjr tests' and 

other tests' of lahgUa^e arts has been caused by repeated 

- claims that a large percentage of high sohool graduates. 
Indeed a large percentage of adults, are "functionally 
Illiterate*" Illiteracy is proclaimed a nartlonal disease, 
A study by researchers at the University of Texas found close 
tp ZQ% of adult Americana to be "functionally Incompetent ^6 
The New York Times reported the results of a Canadian study 
which round J7% of Ganadiari adults to be i u/ic ti uri^l iy 
1 111 terate. 37 Newspapers ^Iso reported a awedl^h atudy 
which fuund 1^% uf Swedish i^th gr»derti Lu br. £ unutl unaiijr 
lilltarate* Do we have an International ilLci&icy crisis 

Ciusar exanii na tl un ut these StiiUl^a reyesla Llj^L ^Qma 
axe inadequate and ^ume are Just silly. I'hitt ^11 ileal Is 
tna aaa^dlari ^uudy. Tha researchers defined "r uiio L i uum J 
liilterate" g^h anyuna Ij years uf a^e ur oldar with l^sa 
limn than: fel^hL year^ or ruruial eduuaLlon. Usiii^ thl ^ 
aLa/id^iu Uii^ X .>und tiiat amcjfi^ WffiiuQJian^ wv.-i o :> iiit^ i.. c^i 
uf^ "1 i 11 Le^iauj^*^ wtta very hl8h, oi;*. Appaii r.u l i 3^ ,,,, ^L.t^nipt 
way made to deterinlfie whcLh^x- Ihuao uia^siflad " I uriQ tl Oii^c^ i 
Illiterate^-* uuuld read 01 Hrile. 

The Swedish study did Mttampt deLsiiiiiua Lhn i o^ai 
ability of their sampla. "Llia reaearohers found th»L 15^ of 
Swedish 12th graders were reading at the 6th grade level. 
Newspapers interpreted this to mean that 1^% ware f uactionall^r 



Illiterate. auch labelling is irresponsible because no 
.attempt^^was made to determln| whether ^the- students reading 
at the '6th grade level can functlaf|| ^ 

, studies such as this one also llliistrate a common mis- 
conception about grade levels. If ,a headline would read 

"Fifty Percent of U»S* Students Bead Below Grade Level" 

some politician is sure to proclaim a literacy crisis. But 
It Is Inevitable that the headline Is true. The mythical 
average 12th grader reads on grade level, 50^ r^ad above this 
level and 50^ read below It, Gr^de levels are statistical 
averages s not mlnlmUBs acceptable levels* liaymen should also 
learn to be skeptical about some of the extremely low scores 
reported* A standardized test does not mefcisure well deviant 
student achievement; It Is pegged tu the itivei to be tested. 
Therefore, the best students will flntt It too easy and the 
weakest students will find It top hard tu be an adequate test, 
I have alsD found that students for whoin a Lest Is vary 
dlffluuj t may becume au frudtrated that Diey 5! ve up, and 
scores uf runotlunMl (but baluw av^ragi^) readeirs do nut aii - 
fer si 511! I i u^at ly I'vom LhM^e uf n^i\ 

The TeXtt& ^tuU^ lu wna .jt the r'cw Lh«L in.w^OM Lj.i, I oiu^a 

t.,^ aaflne tha uump« t.r^nci ea r»aeLl^d by »ij sduit --xnd Lhcii lo 
test these oompet encl as . dut M«rJe HcGIun^ h^s ci^liuea tiu^ai 
the tests developed by the Texas reseaxgheid ^arc uuiLuruiiy 
biased. The examples ha presents raise questions not su much 
about the cultural blaa of the tests, but about th© oonoept 
of adult competence/to begin with/ One of the questions 
on the "Government and Law" sectipfi psks the student to 




■"discuss the concept of party politics Including why the 
tMo-party^ system has. been sijcaessful . " it is ironi? that 
such a tdslf was developed researchers at -the tinlversity ■ 
In a state that has not had a Hepubllcan goVernor In this 
century. 

Une ■would hope that there nil^ht be a moratorium on the 
use of the term "functional illiterate," since no one Is 
quite sure what skills such a person would lack. Paper and 
penoll tests of funotloaal Llllteraojrp while claiming to ^ 
test survival skills, do so In aa artificial context, naced 
in a situation where aurvlyal were at stake, ^sOTne of those 
mo nilirht do poorly on paper and pencil tests ml^ht do con- 
sldar&bly better . I v^a s mLwHym am^^ed , when I taught In an 
Inner city Bostun sohiDOl, how manj of the atudenta "r^-idln^ 
at the secund g^de level" oould pass their driver's test, 

Une wuuld/ also hope that that states, balore comnilttlng 
themselves to/ costly testlag pro^rama that will create neiv 
levels wf buriaucrMQ/, will nmkti Lhalr own attempts to deter- 
mine the extent of th^ lltemcy cribl^. The^ s^hwula ri^t ^ 

be ^uld^a by rmy^lm ^f ioa 8 S llilLesifiw^ ^iid l^ui^LeJ Icm,^! 
Si Ui , 

A is with mt4iiy educaDl u/itil 1 i n . . ^ L 1 , , .i. l.ji *iilui = 

mal cunipetenules la not new. Arthur Appj^L«a, In hi a hi ^torj 
of the teaching of English In thn U/ilted State^^ , .^huw^ hu^ 
a concern for competencies grew uu i of the pro^rasslve juave- 
ment of the 30*s and 40's. At its mu^i uicativ^ the pro^ 
gresslve movement saw defliocracj aa evolving, and It saw 



2D 



eduoatlon as a vital fores in the recdnstTUCtlon^ of .aodlety. 

But naar the .end of the progressive movement, many aduaators 

ware lowarlng their sights ana were stressing "Ufa adjustment," 

What had once bean challenging and Individualistic became 

mediocre and eonformlst, Applabae, in his evaluatdon of the 

■ ..}.-■ ' ' 

pro^easiva years , viaws this shift as clearly a ne^tlve 

ones ^ . ' 

In their concern for genaral education for the 
general student, they adopte* a condescending position 
that removed virtually all ••striving" and challenge 
from the actlvltias suggested, especially for non* 
college-bound students. They allowed their em- 
piricism and pragmatism to narrow their definitions ^ 
of nee&to the point where they were trivial and - 
dull.^0 

itony of those who favor minimal competency testing 
claim that these minimal standards should not unduly in-, 
f luence the curriculum. Proponents usually follow such 
claims with the argument that one of the virtues of com* 
petency' testing Is that It will hold teachers 'and schools 
accountable* If school and teacher performance Is to be 
Judged by student performance on minimal competency tests, 
it is naive to assume that these competencies will not^ be- 
come the focus of Instruction, And, as happened before, 
the curriculum for the general student may be reduced to the 
trivial and the dull. As Gordon CaweltV^has put it there 



It^hi 

is a real likelihood of further trivializing secondary 



education' with a curriculum that is already regarded as 
irrelevant by many students, "^^ 

Such minimalism, according t^o British critic R.L* 
fllackmur, is itself a form of illiteracy* Writing in the 
early JO's Blaokmur's criticism seems relevant todayi 
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This elitala of our culture rlsas frpm the falsa ^- [ 
beliaf that our soclaty raqulraa only ariough mind to* 
' \ ereata and tftnd the niaohlnea togethaB with enough of 

the new "1111 tewiey for other niachlnas— those of 
the mdss mtdla >* to exploit. This Xb ptrhapa the 
the f@|*tt of soolety mdet expansive and wasteful 
of ;^uman talefliti wankl has yet thrown off , 

A flfml Irony In the eompetenoy testlnjf niQvement la the 
timing; One of the gramtei^ aduoatlotol adTOneaa In rae«lt yearS 
has been the use of the Informal reading Inventory In the 
taaohlng of readlns* Prank Qua zak» who haa worked ©stan- . / 

alvely with reading teaohara, has claimed that " the moat 
powerful means of determining ^Individual achievement levels 
are informal tests. Such tests have the virtue of flex- , ' 
Iblllty; they eari be used on different days with different reading 
material. As the name Indloates they are given Informally 
and avoid the authoritarian atmospbare of the standardized 
est. They are easily scored* And if done wellg they can 
provide a great deal^ of diagnostic information. 

As usual , advances In writing instruction are slower* 
But organizations Ilka the Bay Area Writing Project have helped 
tfeachers In diagnosing student, writing problems and In aiding stu- 
dents In revlslngt In England, where all students must pass 
exams to receive certificates of education, a good deal of 
work Is done with the continual assessment of writing. Rather 
than basing an evaluation on a single product produced under 
test conditions, students are evaluated throughout their 
5th ic^ar (age 16). Their final evaluation Is then based on 
on their 10 best pieces of work. 

Procedures like these are pschometrlcally messyi they lack 
the rigid time and topic oontrola that have been a, tradltlort 
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'■'- '^ In writing assesament* V Ju* th^ 

\ they Involve the olassroom teaehar. Those who seek to Im- 
prove literaoy In this way work with the teaohar. As Say- 
aour Sarasortt who^^^^^^ the procese of ohanga in ashoelBigi? 

I ' ; has noted, those who feel that they can legislate ohalfte ^1- 
orten fall " to retfftlA that they are asking teadhtf#s^ to learnt ^ 
and unlearn* 



1 spent one morning going through the MEP writing 
exerolEes and the elaborate means developed for assessing 
writing, '^he more I read, the more depressed I became, not 
because all the exercises were bad (although some were very 
bad), but because there seemed to be something limiting In 
setting any taakr then devising a set of criteria that would 
apply to all the' writing produced* rl^bagan tQ feel like I 
was In an airless room* 

I lipoid wander to the kitchen to fix coffee ani listen 

to my nine-month-old daughter make "b" soundsi "bbbbbBBBBBB,*' 

she would increase volume and smile, delighted with the 

sounds she made. I came back to my study, to minimal 

compatencles and primary trait scoring, reluctantly* I bewn 

to read some of the student work an\ came to one that seemed 

to dispell the gloom* It was written in response to probably 

the most Interesting NAEP toplci ^ 

Imagine you are taking care of a neighbor's 
chjp.dren for an afternoon. lou send one of the 
chl'ldren to the corner store to buy some 
peaches for a snack. 
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> knowh and liked for eaveral years, apparently 
took advantage of the child. The paaohes are rotten. 
You t#arit to serid the child back with the peaehdi : 
and a note to clear up the situation. 

= Wrlt^ a note to th# grocer Wiat ex^regies yoUr 
' ^ displeasura and propoaap what Mr. Jones should 

do about the situation, ^5 / 

After exercises raqulring the writing of phone messages and 
letters of request, hare wa finally h&d something melo* 
drana. The following pieea clearfy baffled the evalua,tors 
who classified it ••genarally factual" and "not personally 
abusive*" I like to think of the writer as somaone who, * / 
as an Infant , delighted In making "b" sounds* 
Dear Mr, Jones i 

I am writing you in regard to the peaches that 
were purohasad by a child I was keeping, I 
wanted some peaches for a snack but as I bit 
into one I found to my horror and* disgust that 
they were rotten. Fortunately , I kept cool, 
I triad so hard to forgive and forget, but the 
child I was keeping abviously couldn't*. After 
eatihg 12 of your rotten peaches she re^urflritated all 
over the carpet but I_ tried to endure it because 
I had a brainstorm, I could faad the ramalj^^g 
peaches to the dog. But as luck would have it 
upon eating the peaches the dog's Jiair fell out. 
However, Mr. Jones even though these terrible things 
happened to me I am not mad, I am merely writing 
to tell you I realized something about you and 
extend you all my sympathy. Because after this 
event I naw realise why you have no teeth or hair, 
because you've eaten your own rotten peaches. T 

Your friend. ^ 
Lee Smith 
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